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DETAILED ACTION 

Claim Objections 

Claim 12 is objected to because of the following informalities: Claim 12 is 
objected to, as the phrase "a touch" is a typographical error. According to claim 12, it is 
unclear as to what input device is associated with the phrase "a touch". Appropriate 
correction is required. 

Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S. C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

Claims 1,4, 17 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Hatifield et al. (Patent No. 6,243,076). 

As to independent claim 1 , Hatifield et al. teaches: 
A method of interacting with a monitor (see e.g., col. 4, lines 40 - 55; i.e., the user 
manipulates a "comet" on a display by using eye gaze), comprising: modifying a portion 
of an output displayed on a monitor (see e.g., col. 10, lines 18-29; i.e., the user is able 
to modify a portion of the display by activating comet 309, 313, and 317, wherein the 
modification of a portion of a display corresponds to scrolling vertically or horizontally 
through the readable text or closing the help text display) by tracking an eye gaze (see 
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e.g., col. 10, lines 18-29; i.e., comet 309, 313, and 317 are tracked by the user) and 
by monitoring an input indicator (see e.g., col. 6, lines 14-24; i.e., 17-21; i.e., the 
system monitors the association of comet movement and input device movement) on 
the monitor that reflects a user's activity (see e.g., col. 6, lines 14-24; i.e., input 
devices, such as a mouse, trackball, or joystick can be used to reflect a user's activity, 
wherein the system monitors the user's point-of-interest), wherein the output comprises 
at least part of a target object (see e.g., col. 10, lines 18-29; i.e., the target object 
corresponds to the readable text file invoked by the user, wherein parts of the readable 
document can be scrolled horizontally or vertically through the use of comet 309, 313, 
and 317); wherein tracking the eye gaze comprises monitoring a user's eye movement 
(see e.g., coL 10, lines 18-21; i.e., the system monitors the eye gaze tracked by the 
user of comet 309) in a direction of the target object (see e.g., col. 10, lines 18-21; i.e., 
the direction of the target object corresponds to the tracking of a user's horizontal or 
vertical eye gaze of the readable help document using .comet 309, 313, and 317), and 
further monitoring a trajectory of the input indicator on the monitor (see e.g., col. 6, lines 
14 - 21 ; i.e., the system monitors the movement and direction of the input device 
towards the comet); and wherein the portion of the output is modified (see e.g., col. 10, 
lines 18-29; i.e., the user is able to modify a portion of the display by activating 309, 
313, and 317) upon detecting the coincidence of the user's eye movement (see e.g., 
col. 1 0, lines 18-21; i.e. , when comet 309 is tracked by the user's eye gaze, and a 
portion of the display is scrolled up) and the input indicator trajectory in the direction of 
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the target object (see e.g., col. 6, lines 14 - 24; i.e., the modification to a portion of the 
display is modified with input devices, such as a mouse, trackball, or joystick). 

As to dependent claim 4, Hatifield et al. teaches: 
The method according to claim 1, further comprising identifying the target object through 
eye-gaze tracking (see e.g., col. 10, lines 18-21; i.e., identifying the target through 
eye-gaze tracking object corresponds to the tracking of a user's horizontal or vertical 
eye gaze of the readable help document using comet 309, 313, and 317). 

As to independent claim 17, Hatifield et al. teaches: 
Independent claim 17 differs from claim 1 only in that claim 17 is an apparatus claim 
using a software program product (see e.g., col. 5, lines 44 - 55; i.e., memory, and 
external storage devices and media) containing executable instructions (see e.g., col. 5, 
lines 49 - 55; i.e., the software may reside on an external storage media) that when 
executed causes a processor (see e.g., col. 5, lines 49 - 52; i.e., the software may 
reside in a process space of the central processing unit) to perform the method of claim 
1. Thus, claim 17 is analyzed as previously discussed with respect to claim 1 above. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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Claims 2, 3, 5 - 16, and 18 - 20 are rejected under 35 U.S. C. 103(a) as being 
unpatentable over Hatifield et al. (Patent No. 6,243,076) in view of Tognazzini et al. 
(Patent No. 5,886,683). 

As to dependent claim 2, this claim is analyzed with respect to claim 1 as 
previously discussed above. Hatifield et al. teaches modifying a portion of the output 
(see e.g., col. 10, lines 18-29; i.e., the user is able to modify a portion of the display by 
activating comet 309, 313, and 317, wherein the modification of a portion of a display 
corresponds to scrolling vertically or horizontally through the readable text or closing the 
help text display), but does not specifically mention expanding the portion of the output. 
Tongnazzini et al. teaches expanding the portion of the output (see e.g., Fig. 10-11 
and col. 14, lines 25 - 27; i.e., expanding a portion of the output corresponds to article 
1 1 07 and title 1 1 05 expanding in size in comparison to article 1115 and title 1113). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate modifying a portion of the output on a display of 
Hatifield et al. with expanding a portion of the output of Tongnazzini et al. because the 
size expansion of a portion of the readable document allows a more comfortable size for 
reading (see e.g., 14, lines 25 - 27). 

As to dependent claim 3, this claim is analyzed with respect to claim 1 as 
previously discussed above. Hatifield et al. teaches modifying a portion of the output 
(see e.g., col. 10, lines 18-29; i.e., the user is able to modify a portion of the display by 
activating comet 309, 313, and 317, wherein the modification of a portion of a display 
corresponds to scrolling vertically or horizontally through the readable text or closing the 
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help text display), but does not specifically mention contracting the portion of the output. 
Tongnazzini et al. teaches contracting the portion of the output (see e.g., Fig. 10-11 
and col. 14, lines 29 - 38; i.e., contracting a portion of the output corresponds to the 
size reduction of article 1115 and title 1113). Therefore, it would have been obvious to 
one of ordinary skill in the art at the time the invention was made to incorporate 
modifying a portion of the output on a display of Hatifield et al. with contracting a portion 
of the output of Tongnazzini et al. because the size reduction of a portion of the 
readable document allows a more comfortable size for reading the targeted portion (see 
e.g., 14, lines 25-27). 

As to dependent claim 5, this claim is analyzed with respect to claim 4 as 
previously discussed above. Hatifield et al. teaches modifying a portion of the output 
(see e.g., col. 10, lines 18-29; i.e., the user is able to modify a portion of the display by 
activating comet 309, 313, and 317, wherein the modification of a portion of a display 
corresponds to scrolling vertically or horizontally through the readable text or closing the 
help text display) that contains the target object (see e.g., col. 10, lines 18-29; i.e., the 
target object corresponds to the readable text file invoked by the user, wherein parts of 
the readable document can be scrolled horizontally or vertically through the use of 
comet 309, 313, and 317), but does not specifically mention transforming the portion of 
the output containing the target object to accommodate the expansion and contraction 
of the target object. Tongnazzini et al. teaches transforming the portion of the output 
object (see e.g., Fig. 10-11 and col. 14, lines 22 - 38; i.e., transforming the portion of 
the output corresponds to Fig. 1 1 , wherein article 1 107 and title 1 105 are expanded, 
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while article 1115 and title 1 1 13 are contracted) containing the target (see e.g., Fig. 10 - 
11 and col. 14, lines 25-27; i.e., the target corresponds to article 1107 and title 1105) 
to accommodate the expansion and contraction of the target object (see e.g., Fig. 10 - 
1 1 and col. 1 4, lines 22 - 38; i.e. , article 1115 and title 1113 are transformed to 
accommodate the expanding of article 1 107 and title 1 105). Therefore, it would have 
been obvious to one of ordinary skill in the art at the time the invention was made to 
incorporate modifying a portion of the output that contains the target object of Hatifield 
et al. with transforming the portion of the output containing the target object to 
accommodate the expansion and contraction of the target object of Tongnazzini et al. 
because the size reduction of a portion of the readable document allows a more 
comfortable size for reading the targeted portion (see e.g., 14, lines 25 - 27). 

As to dependent claim 6, this claim is analyzed with respect to claim 5 as 
previously discussed above. Hatifield et al. teaches determining a modification time 
based on data derived concurrently from the user's eye gaze (see e.g., col. 5, lines 36 - 
43; the modification time corresponds to an arbitrary period of time, wherein the time 
and action of a function is derived from a user's point-of-gaze track and other various 
conditions). 

As to dependent claim 7, this claim is analyzed with respect to claim 5 as 
previously discussed above. Hatifield et al. teaches determining a motion direction of 
the input indicator (see e.g., col. 6, lines 14 - 24). 

As to dependent claim 8, this claim is analyzed with respect to claim 5 as 
previously discussed above. Hatifield et al. teaches identifying the target object based 
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on data derived concurrently from the eye gaze and the direction of movement of the 
input indicator (see e.g., col. 6, lines 14-31; i.e., identifying a target object can be 
based on data derived from eye gaze, input indicator, combinations and 
subcombinations of eye gaze and input indicators). 

As to dependent claim 9, this claim is analyzed with respect to claim 1 as 
previously discussed above. Hatifield et al. teaches interactive graphical user interface 
components (see e.g., col. 9, lines 35 - 38; i.e., the graphical user interface 
components corresponds to drop down list boxes, check boxes, edit fields, and various 
buttons). Hatifield et al. does not specifically mention identifying the portion of the output 
based on boundaries of interactive graphical user interface components. Tongnazzini et 
al. teaches identifying the portion of the output based on boundaries (see e.g., col. 14, 
lines 56 - 60; i.e., the text are magnified but have limited boundaries for magnification). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the interactive graphical user interface components 
of Hatifield et al. with identifying the portion of the output based on boundaries of 
interactive graphical user interface components of Tongnazzini et al. because the 
magnification limit is an essential structure to retain comfortable visualization of 
graphical user interface components (see e.g., col. 14, lines 60 - 65). 

As to dependent claim 10, this claim is analyzed with respect to claim 9 as 
previously discussed above. Hatifield et al. teaches the interactive graphical user 
interface components comprise any one or more of a button (see e.g., col. 9, lines 37 - 
38; i.e., various buttons), a menu (see e.g., col. 9, line 32; i.e., main menu), a scrollbar, 
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and a hypertext link (see e.g., col. 7, lines 26 - 28; those skilled in the art would 
appreciate that graphical user interface components to control web browsers include to 
hypertext links and scroll bars). 

As to dependent claim 1 1 , this claim is analyzed with respect to claim 10 as 
previously discussed above. Hatifield et al. teaches the interactive graphical user 
interface components to permit interactivity (see e.g., Fig. 3A - 3C and col. 7, lines 26 - 
28; the graphical user interface components can be used to interact with web browsers 
and window display 301), but does not specifically mention expanding the interactive 
graphical user interface components. Tongnazzini et al. teaches expanding interactive 
graphical user interface components (see e.g., Fig. 11-12 and col. 14, lines 25 - 27; 
i.e., the graphical interface component corresponds to expanding article 1 107 and title 
1 105 in comparison to the size of article 1115 and title 1113). Therefore, it would have 
been obvious to one of ordinary skill in the art at the time the invention was made to 
incorporate the interactive graphical user interface components to permit interactivity of 
Hatifield et al. with expanding the interactive graphical user interface components of 
Tongnazzini et al. because expansion of graphical user interface components enable 
comfortable visualization of the components (see e.g., col. 14, lines 60 - 65) 

As to dependent claim 12, this claim is analyzed with respect to claim 5 as 
previously discussed above. Hatifield et al. teaches the input indicator (see e.g., col. 17, 
lines 43 - 49; i.e., the input indicator corresponds to a cursor associated with an input 
device) is inputted by an input device that comprises any one or more of a mouse (see 
e.g., col. 17, lines 43 - 44; i.e., conventional mice, remote mice), a touch screen (see 
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e.g., coL 2, line 5; i.e., touch screen), a tablet computer (see e.g., col. 2, lines 5 - 6), a 
personal digital assistant (see e.g., col. 17, line 49; i.e., microprocessor-based system 
or device), a stylus (see e.g., col. 17, lines 44; i.e., light pens), and a motion sensor (see 
e.g., Fig. 1 and col. 9, line 29; i.e., eye tracker controller 129). 

As to dependent claim 13, this claim is analyzed with respect to claim 5 as 
previously discussed above. Hatifield et al. teaches modifying a portion of the output 
(see e.g., col. 10, lines 18-29; i.e., the user is able to modify a portion of the display by 
activating comet 309, 313, and 317, wherein the modification of a portion of a display 
corresponds to scrolling vertically or horizontally through the readable text or closing the 
help text display) that contains the target object (see e.g., col. 10, lines 18-29; i.e., the 
target object corresponds to the readable text file invoked by the user, wherein parts of 
the readable document can be scrolled horizontally or vertically through the use of 
comet 309, 313, and 317). Hatifield et al. does not specifically mention transforming the 
portion of the output comprises hiding an area of the monitor that is covered by an 
increase in size of the target object to accommodate a change in appearance of the 
target object. Tongnazzini et al. teaches transforming the portion of the output (see e.g., 
Fig. 10-11 and col. 14, lines 22 - 38; i.e., transforming the portion of the output 
corresponds to Fig. 1 1 , wherein article 1 107 and title 1 1 05 are expanded, while article 
1115 and title 1 1 1 3 are contracted) comprises hiding an area of the monitor that is 
covered by an increase in size of the target object (see e.g., Fig 10 - 1 1 and col. 14, 
lines 35 - 38; i.e., the articles associated with title 1 109 and 1117 have been shifted off 
screen to accommodate the expansion of article 1 107 and title 1 105, wherein article 
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1 107 and title 1 105 are the target objects) to accommodate a change in appearance of 
the target object (see e.g., Fig 10 - 1 1 and col. 14, lines 35 - 38). Therefore, it would 
have been obvious to one of ordinary skill in the art at the time the invention was made 
to incorporate modifying a portion of the output that contains the target object of 
Hatifield et al. with transforming the portion of the output, which comprises hiding an 
area of the monitor that is covered by an increase in size of the target object to 
accommodate a change in appearance of the target object of Tongnazzini et al. 
because the size increase of the target allows a more comfortable size for reading (see 
e.g., 14, lines 25 -27). 

As to dependent claim 14, this claim is analyzed with respect to claim 5 as 
previously discussed above. Hatifield et al. teaches modifying a portion of the output 
(see e.g., col. 10, lines 18-29; i.e., the user is able to modify a portion of the display by 
activating comet 309, 313, and 317, wherein the modification of a portion of a display 
corresponds to scrolling vertically or horizontally through the readable text or closing the 
help text display) that contains the target object (see e.g., col. 10, lines 18-29; i.e., the 
target object corresponds to the readable text file invoked by the user, wherein parts of 
the readable document can be scrolled horizontally or vertically through the use of 
comet 309, 313, and 317). Hatifield et al. does not specifically mention transforming the 
portion of the output comprises moving one or more objects on the monitor toward one 
or more edges of the monitor to accommodate a change in appearance of the target 
object. Tongnazzini et al. teaches transforming the portion of the output (see e.g., Fig. 
10-11 and col. 14, lines 22-38; i.e., transforming the portion of the output 



Application/Control Number: 10/648,120 Page 12 

Art Unit: 2179 

corresponds to Fig. 1 1 , wherein article 1 107 and title 1 105 are expanded, while article 
1115 and title 1 1 13 are contracted) comprises moving one or more objects on the 
monitor toward one or more edges of the monitor (see e.g., Fig. 10-11 and col. 14, 
lines 22 - 38; i.e., article 1 107 and title 1 105 have been expanded, wherein article 1115 
and title 1 1 09, 1113, and 1117 have been moved to the edge of the monitor to 
accommodate the expansion of article 1 107 and title 1 105) to accommodate a change 
in appearance of the target object (see e.g., Fig 10 - 1 1 and col. 14, lines 35 - 38). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate modifying a portion of the output that contains the 
target object of Hatifield et al. with transforming the portion of the output, which 
comprises moving one or more objects on the monitor toward one or more edges of the 
monitor to accommodate a change in appearance of the target object of Tongnazzini et 
al. because the size increase of the target allows a more comfortable size for reading 
(see e.g., 14, lines 25-27). 

As to dependent claim 15, this claim is analyzed with respect to claim 5 as 
previously discussed above. Hatifield et al. teaches modifying a portion of the output 
(see e.g., col. 10, lines 18-29; i.e., the user is able to modify a portion of the display by 
activating comet 309, 313, and 317, wherein the modification of a portion of a display 
corresponds to scrolling vertically or horizontally through the readable text or closing the 
help text display) that contains the target object (see e.g., col. 10, lines 18-29; i.e., the 
target object corresponds to the readable text file invoked by the user, wherein parts of 
the readable document can be scrolled horizontally or vertically through the use of 
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comet 309, 313, and 317). Hatifield et al. does not specifically mention transforming the 
portion of the output comprises reducing a size of one or more objects located adjacent 
the target object to accommodate a change in appearance of the target object while 
maintaining an original appearance of a remaining portion of the output. Tongnazzini et 
al. teaches transforming the portion of the output (see e.g., Fig. 10-11 and col. 14, 
lines 22 - 38; i.e., transforming the portion of the output corresponds to Fig. 1 1 , wherein 
article 1 1 07 and title 1 1 05 are expanded, while article 1115 and title 1 1 1 3 are 
contracted) comprises reducing a size of one or more objects located adjacent the 
target object (see e.g., Fig. 10-11; i.e., article 1107 and title 1105 are expanded while 
adjacent article 1115 and title 1 1 13 are reduced in size) to accommodate a change in 
appearance of the target (see e.g., Fig 10 - 11 and col. 14, lines 22 - 38) while 
maintaining an original appearance of a remaining portion of the output (see e.g., Fig. 
10-11; i.e., title 1109 and 1117 maintain their original appearance in comparison to 
article 1 107, 1 1 15 and title 1 105, 1 113). Therefore, it would have been obvious to one 
of ordinary skill in the art at the time the invention was made to incorporate modifying a 
portion of the output that contains the target object of Hatifield et al. with transforming 
the portion of the output, which comprises reducing a size of one or more objects 
located adjacent the target object to accommodate a change in appearance of the 
target object while maintaining an original appearance of a remaining portion of the 
output of Tongnazzini et al. because the size increase of the target allows a more 
comfortable size for reading (see e.g., 14, lines 25 - 27). 
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As to dependent claim 16, this claim is analyzed with respect to claim 12 as 
previously discussed above. Hatifield et al. teaches the input indicator (see e.g., col. 17, 
lines 43- 49) is inputted by an input device (see e.g., Fig. 1 and col. 8, lines 1 - 52), 
does not specifically mention restoring the target object and the monitor to an original 
appearance when any one of the eye-gaze or the input device indicates that the target 
object has been deselected. Tongnazzini et al. teaches restoring the target object and 
the monitor to an original appearance (see e.g., col. 15, lines 3-5; i.e., when the user's 
gaze leaves window 1201 , the monitor and text in window 1201 is reduced to its original 
appearance) when any one of the eye-gaze (see e.g., col. 15, lines 3 -5) or the input 
device indicates that the target object has been deselected (see e.g., col. 15, lines 5 - 
7; i.e., the pointing device can be used to invoke a command function to return the 
appearance of the text and monitor). Therefore, it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to incorporate the input 
indicator and input device of Hatifield et al. with the restoring of the target object and the 
monitor to an original appearance when any one of the eye-gaze or the input device 
indicates that the target object has been deselected of Tongnazzini et al. because the 
slowly expanding and slowly contracting of a target object reduces user distraction (see 
e.g., col. 15, lines 48 -54). 

As to dependent claim 18, claim 18 differs from claim 2 only in that claim 18 is an 
apparatus claim using a software program product (see e.g., col. 5, lines 44 - 55; i.e., 
memory, and external storage devices and media) containing executable instructions 
(see e.g., col. 5, lines 49 - 55; i.e., the software may reside on an external storage 
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media) that when executed causes a processor (see e.g., col. 5, lines 49 - 52; i.e., the 
software may reside in a process space of the central processing unit) to perform the 
method of claim 2. Thus, claim 18 is analyzed as previously discussed with respect to 
claim 2 above. 

As to dependent claim 19, claim 19 differs from claim 3 only in that claim 19 is an 
apparatus claim using a software program product (see e.g., col. 5, lines 44 - 55;' i.e., 
memory, and external storage devices and media) containing executable instructions 
(see e.g., col. 5, lines 49 - 55; i.e., the software may reside on an external storage 
media) that when executed causes a processor (see e.g., col. 5, lines 49 - 52; i.e., the 
software may reside in a process space of the central processing unit) to perform the 
method of claim 3. Thus, claim 19 is analyzed as previously discussed with respect to 
claim 3 above. 

As to independent claim 20, claim 20 incorporates substantially similar subject 
matter as claimed in claim 17 above, and are respectfully rejected along the same 
rationale. 

Conclusion 

The prior art made of record and. not relied upon is considered pertinent to 
applicant's disclosure. Prior art Patent No. 6,594,687 can be made applicable and 
pertinent to applicant's disclosure. Prior art disclosed by Yap et al. teaches concurrently 
monitoring a user's eye gaze with association to following a mouse pointer for a more 



Application/Control Number: 10/648,120 Page 16 

Art Unit: 2179 

accurate calibration, wherein other advantages include zooming in and zooming out of 
graphical objects. 
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